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SYSTEM AND METHOD OF 
PROVIDING SECURITY FOR A SITE 

BACKGROUND OF THE INVENTION 

1 . Field of the Invention 

[0001] The present disclosure generally relates to providing security for 
a site. In particular, the present disclosure relates to non-intrusive identification 
and tracking of individuals throughout a site. 

2. Description of the Related Art 

[0002] There is a growing need for security in our world. As a result, 
buildings that were once open to the public are now restricted to authorized 
personnel Offices, shopping malls, airports, and other public places need to track 
individuals while they are on site. Offices often have badges and sometimes have 
fingerprint readers for employee access. Shopkeepers in malls have closed circuit 
television cameras to detect shoplifting of merchandise. Airports restrict access to 
authorized personnel beyond certain checkpoints, while other areas are open to the 
public. For example, an airline employee gains access when his badge is seen by a 
security guard at a checkpoint and passengers gain access to a plane after stopping 
and handing a boarding pass to a clerk at another checkpoint. 

[0003] Checkpoints are used in many environments to control access in 
specific areas. Initial checkpoints often are the only formal security check. Most 
checkpoints are located at the periphery of the controlled area, like walls guarding 
a fort, a moat around a castle, or customs personnel at the border. However, this 
leads to poor security performance. Once an unauthorized person or object gains 
access into the controlled area past a checkpoint, by deception, by not being 
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detected, by climbing a wall, or by slipping in through a backdoor, the person 
typically is not interrogated by any other security system. The most common 
reason checkpoints let unauthorized personnel into the controlled area is that they 
rely on human judgment. 

[0004] Biometrics is sometimes used at an initial checkpoint. 
Biometrics is the science and technology of measuring and statistically analyzing 
biological data. In information technology, biometrics usually refers to 
technologies for measuring and analyzing human body characteristics such as 
fingerprints, eye retinas and irises, voice patterns, facial patterns, and hand 
measurements, especially for authentication purposes. Fingerprint identification 
and iris scanning are intrusive, create long lines, require a pre-established 
database, and are not easily used within a controlled area. Also, they are only 
used for tracking humans, not objects. Some biometric systems tend to be focused 
on a particular method to the exclusion of other methods. Face scans are limited 
in their ability to work if a camera is in the wrong position or in a position 
different from an original position. 

[0005] There is a need for a non-intrusive way to identify individuals so 
that they do not have to carry anything and do not have to stop and do something 
at a checkpoint. After an initial checkpoint, there is a need for tracking 
individuals throughout a site. For example, when someone walks out of a 
controlled area into somewhere without a tracking device, such as a washroom 
and then walks back into the controlled area, their identity needs to be re- 
established. There is a need for predicting events at later checkpoints based on 
events at earlier checkpoints. There is a need for a system accommodating new 
and different types of sensors. There is a need for automating various tasks of 
security guards to increase their productivity. 
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SUMMARY OF THE INVENTION 

[0006] The present disclosure is directed to systems and methods of 
providing security for a site that satisfies one or more of these needs. 

[0007] One version is a system for providing security, which comprises 
at least two sensors, a third sensor, and at least one computing device. At a first 
position, the first two sensors capture a first sensed data about an individual. At a 
second position, the third sensor captures a second sensed data about the 
individual. The computing device establishes the identity of the individual by 
comparing the first and second sensed data. In one embodiment, the system also 
comprises a statistical model to generate a confidence measure used in 
establishing the identity of the individual. In another embodiment, the computing 
device generates profile information for the individual at the first position and 
generates predicted information for the individual at the second position based at 
least in part on the profile information. In another embodiment, the computing 
device compares the predicted information to the second sensed data to establish 
the identity of the individual. In another embodiment, the first two sensors are 
non-intrusive sensors. 

[0008] Another version is a method for providing security. At a first 
position, at least two sensors capture a first sensed data about an individual. A 
profile is generated based on the first sensed data and the identity of the individual 
is established. Predicted information is generated based on the profile. At a 
second position, at least a third sensor captures a second sensed data about the 
individual. Then, the predicted information is compared with the second sensed 
data. In one embodiment, the identity is established within a confidence 
threshold. In another embodiment, an alert is produced when the identity is not 
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confirmed by the comparing step. In another embodiment, the two sensors are 
non-intrusive sensors. In another embodiment, the non-intrusive sensors are 
cameras. In another embodiment, the profile is a 3D model. In another 
embodiment, the identity is established at least in part by a facial recognition 
system. 

[0009] Another version is a computer readable medium having 
instructions for performing a method for providing security. At a first position 
where an object is within range, a sensor data is captured non-intrusively. A 
profile is generated based on the sensor data. An attempt is made to identify the 
object within a confidence threshold. At a second position, the profile and sensor 
data is used to attempt to identify the object. In one embodiment, the object is an 
individual. In another embodiment, the object is a piece of equipment. In another 
embodiment, an event is identified and associated with the object. In another 
embodiment, an alert is produced about the event. In another embodiment, at a 
second position, a second object is identified that was not identified at the first 
position. In another embodiment, the sensor data is captured by at least one 
camera. In another embodiment, the camera is part of a distributed camera 
network. In another embodiment, views are automatically generated for a face 
recognition system. In another embodiment, security effectiveness is tested by 
equipping known objects with location tracking devices. 



BRIEF DESCRIPTION OF THE DRAWINGS 

[0010] These and other features, aspects, and advantages of the present 
disclosure will become better understood with reference to the following 
description, appended claims, and drawings where: 
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[0011] FIG. 1 is a block diagram of an example system for providing 
security for a site. 

[0012] FIG. 2 is a flow diagram of an example method for providing 
security for a site. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

[0013] FIG. 1 shows an example system 100 of providing security for a 
site. When an individual 102 is within range of a first checkpoint 104, 
information is captured about the identity of individual 102 by a first sensor 106 
and a second sensor 108. An identity is who individual 102 is, such as a particular 
employee, a general identity such as an intruder, or a collection of profile 
information. When individual 102 is within range of a second checkpoint 110, 
additional information is captured about the identity of individual 102 by a third 
sensor 1 12. First sensor 106, second sensor 108, and third sensor 112 
communicate via a network 1 14 with a computing device 116, which produces 
output 118. 

[0014] First checkpoint 104 and second checkpoint 1 10 are locations in 
a site where information is captured about the identity of individual 102. For 
example, first checkpoint 1 04 is located near an entrance to a stadium and 
checkpoint 1 10 is located near a backdoor to the stadium. System 100 may 
contain additional checkpoints. First checkpoint 104 and second checkpoint 110 
may be located anywhere in or around the stadium and may contain additional 
sensors. 

[0015] First sensor 106, second sensor 108, and third sensor 1 12 are any 
type of sensor and may all be the same type or different types. First sensor 106, 
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second sensor 108, and third sensor 1 12 may be active or passive. An active 
sensor sends, receives, and processes information while a passive sensor only 
receives information. First sensor 106, second sensor 108, and third sensor 112 
may be biometric or quasi-biometric. A biometric sensors measures and analyzes 
human body characteristics. A quasi-biometric sensor has some degree of 
biometrics in combination with other types of sensors. Examples of biometric 
sensors include fingerprints, eye retinas and irises, voice patterns, facial patterns, 
and hand measurements. Other examples of sensors include heart rhythm 
detectors, biological detectors, and thermal scanners. System 100 may employ 
other kinds of sensors and incorporate new sensors. Preferably, first sensor 106, 
second sensor 108, and third sensor 1 12 are minimally intrusive or non-intrusive 
on individual 102. Depending on the site, more intrusive or active sensors such as 
fingerprint scanners may be used for first sensor 106, second sensor 108, and third 
sensor 112. The system may also employ the use of structured light or other 
environmental effects to aid the sensors. A distributed network of cameras is 
employed in one embodiment. 

[0016] Network 1 14 is any kind of network, such as wireless or 
Ethernet. First sensor 106, second sensor 108, and third sensor 1 12 communicate 
with computing device 1 16 over network 114. 

[0017] Computing device 1 16 is any kind of device having a processor, 
such as a personal computer or a server. System 100 has one or more computing 
device 116. Various configurations of computing device 116 and first sensor 106, 
second sensor 108, and third sensor 1 12 are possible to distribute processing 
power. In a centralized example, computing device 1 16 retrieves all captured 
information from first sensor 106, second sensor 108, and third sensor 1 12 for 
processing. In a distributed example, first sensor 106, second sensor 108, and 
third sensor 1 12 include processors and software components for pre-processing 
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captured information before sending it to computing device 1 16 for additional 
processing. 

[0018] Computing device 1 16 has software components for processing 
captured information and performing tasks of system 100. Many different kinds 
of software components may be used, such as software to convert captured 
information into digital form, data analysis tools, and database management. 
Some examples include image capture, 3D graphics tools, comparison engines, 
face recognition software, and database indexing capability. Indexing capability is 
the ability to query the database for identity information. 

[0019] Output 1 18 is produced by computing device 1 16 as a result of 
operating system 100. For example, individual 102 enters the stadium and comes 
within range of first checkpoint 104. First sensor 106 and second sensor 108 are 
cameras that capture image information about individual 1 02 and send the image 
information over network 1 14 to computing device 116. Computing device 116 
processes the image information to establish the identity of individual 102 and 
generates a profile of individual 102. The identity and profile of individual 102 
are examples of output 118. The profile is a collection of information about 
individual 102, such as height, build, and appearance. Then, computing device 
116 generates prediction information to predict what individual 102 will look like 
when individual 102 is within range of second checkpoint 110. If first sensor 106 
is calibrated to capture an image of individual 1 02 from a top view, second sensor 
108 is calibrated to capture an image of individual 102 from a side view, and third 
sensor 1 12 is calibrated to capture an image of individual 102 from a front view, 
computing device 116 predicts a front view for third sensor 1 12 by manipulating 
the images in the profile. Computing device 116 may also use additional 
information for such predictions, such as a database of characteristics of various 
populations of people. 
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[0020] Another example of output 1 1 8 is an alert for a security guard. 
Suppose second checkpoint 1 10 is located near the backdoor of the stadium. At 
second checkpoint 1 10, system 100 detects an intruder that did not pass first 
checkpoint 104 at the stadium entrance. Computing device 1 16 determines that 
the intruder did not pass first checkpoint 104 by comparing image information 
about the intruder captured by third sensor 1 12 to image information in a profile 
and predicted information stored in a database of individuals 102 that passed first 
checkpoint 104. Then, computing device 1 16 produces the alert. Furthermore, 
system 100 takes other actions, such as increasing surveillance by tracking 
individual 102 at every checkpoint throughout the site. Additional output 118 
may also be provided, such as stored images from additional sensors tracking the 
intruder from outside the site through the backdoor to second checkpoint 110. 

[0021] FIG. 2 shows an example method 200 for providing security for 
a site, which may be used to operate the example system 100 of FIG. 1. In step 
202, first sensor 106 and second sensor 108 at first checkpoint 104 capture 
information about individual 102. In step 204, computing device 1 16 generates a 
profile. In step 206, computing device 1 16 establishes the identity of individual 
102. In step 208, computing device 116 generates predicted information for use at 
second checkpoint 110. In step 210, computing device 116 re-establishes the 
identity of individual 102 at second checkpoint 110. 

[0022] An example of step 202 is where first checkpoint 1 04 is located 
at the entrance of the stadium. First sensor 106 and second sensor 108 are 
cameras that capture multiple images of individual 1 02 and send the images to 
computing device 116. 
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[0023] An example of step 204 is where computing device 1 16 
generates a facial profile of individual 102 based on the captured images. 

[0024] An example of step 206 is where computing device 116 searches 
an employee database for information matching the facial profile and establishes 
that individual 102 is a particular employee with confidence measure of 80%, 
which meets a predetermined confidence threshold. Generally, confidence 
measures are statistical estimates of the certainty of a particular result in a 
population. The confidence measure may also be a lack of confidence, such as 
when the intruder is detected at second checkpoint 110. In an alternate 
embodiment, first sensor 106 and second sensor 108 captured biometric 
information. In this case, computing device 1 16 reduces the biometric 
information into a set of parameters to compare against stored templates in a 
process called template matching. 

[0025] An example of step 208 is where computing device 116 uses the 
facial profile to generate predicted information. The predicted information is the 
images likely to be captured by third sensor 112. 

[0026] An example of step 210 is where second checkpoint 1 10 is 
located near a concession stand and third sensor 1 12 is a laser scanner. Third 
sensor 1 12 performs a full 3D scan as well as direct scans of the ear, the eye, and 
the face of individual 102, while individual 102 is waiting in line. From this full 
3D scan, computing device 116 generates a set of 3D structures, a general 
structure of individual 102, and a model for creating future predictions. 
Computing device 116 automatically generates and sends views to a face 
recognition system. Information returned to computing device 116 from the face 
recognition system is used to re-establish the identity of individual 102. At a later 
checkpoint, computing device 116 extracts a particular representation of the ear 
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from the model and compares it to a new scan of the ear to re-establish the identity 
of individual 102. 

[0027] Another example of step 2 10 is where third sensor 1 12 is a 
camera in a hallway with an oblique view of individual 102. Since the face of 
individual 102 is not readily captured, third sensor 1 12 captures the height of 
individual 102. Computing device 116 compares predicted information generated 
in step 208 with the profile generated in step 204 and a statistical model 
containing height distribution across the general population to attempt to identify 
individual 102. If computing device 116 knows that there is only one person on 
the site who is supposed to be on the site and he is six foot five inches tall, then 
computing device 116 has increased confidence that individual 102 with that 
height has access. On the other hand, if individual 102 is in the middle of a range 
of average height, then computing device 1 16 has decreased confidence that 
individual 102 has access. Computing device 116 changes the confidence 
threshold to be based on who is currently on the site rather than on the total 
population. As individual 102 passes various additional sensors at additional 
checkpoints, eventually enough information is accumulated so that system 100 can 
identify individual 102. At each checkpoint, system 100 provides the best 
information so far for identification purposes. In addition, system 100 uses 
predicted information to increase efficiency by reducing computation and sensor 
activity. For example, computing device 1 1 6 uses a search only for establishing 
or re-establishing an identity. Thus, even without universal coverage for a site, 
identification and tracking may be done confidently. 

[0028] Testing is conducted for some embodiments by equipping 
known individuals with location tracking devices, such as global positioning 
systems (GPS) or an indoor equivalent and determining if system 100 tracks them 
throughout the site. 
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[0029] Similar systems and methods are used for identifying objects, 
such as equipment as used for identifying individuals. Additionally, events 
associated with establishing the identity of individual 1 02 are processed by system 
100, in some embodiments. For example, one event is the initial identification of 
individual 102 at first checkpoint 104. Another event is detecting an intruder and 
so on. 

[0030] It is to be understood that the above description is intended to be 
illustrative and not restrictive. Many other embodiments will be apparent to those 
of skill in the art upon reviewing the above description, such as adaptations of the 
present disclosure to homes, warehouses, buildings, sports arenas, country borders 
and any other areas that need security. Various types of hardware and software are 
contemplated by the present disclosure, even though some minor elements would 
need to change to better support the environments common to such systems and 
methods. The present disclosure has applicability to fields outside offices, 
shopping malls, and airports, such as home security and other kinds of security. 
Therefore, the scope of the present disclosure should be determined with reference 
to the appended claims, along with the full scope of equivalents to which such 
claims are entitled. 
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